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I  have  selected  three  classical  problems  -  dis¬ 
crete  Fourier  analysis,  linear  prediction,  and  nonlin¬ 
ear  phase  and  frequency  demodulation  -  to  illustrate 
the  use  of  dynamic  programing  in  control  and  signal 
processing.  The  first  two  problems  illustrate  the  use 
of  dynamic  programing  in  the  (re-)  derivation  of  the 
FFT  and  Levinson  algorithms,  two  of  the  best  known  and 
most  widely  used  fast  algorithms.  The  last  problem 
illustrates  how  dynamic  programming  can  provide  comfort 
in  those  applications  where  recursively  computable, 
finite-dimensional  sufficient  statistics  are  nowhere 
to  be  found. 

\  I.  Introduction 

When  1  was  a  graduate  student  at  the  University 
of  Washington  in  the  late  1960s,  the  control  students 
studied  dynamic  programming  and  the  communication  stu¬ 
dents  didn't.  I  didn't.  In  the  early  1970s,  while 
covering  a  controls  class  for  one  of  my  colleagues  at 
Colorado  State  University,  I  was  forced  to  work  through 
one  of  those  classical  dynamic  programming  problems 
involving  a  weary  salesman ,  a  balky  stationvagon  and 
a  sales  territory  as  big  as  the  whole  outdoors.  I 
remember  finding  the  insights  and  techniques  of  dynamic 
programing  interesting.  I  remember  finding  the  prob¬ 
lem  fun  to  work.  But  I  do  not  remember  thinking,  "... 
here  is  a  generally  applicable  technique  that  can  make 
my  life  in  signal  processing  easier." 

In  the  mid-1970s  I  read  a  paper  by  Charles  Cahn 
[1]  concerning  the  so-called  Vlterbi  algorithm  and  its 
application  to  FM  demodulation.  The  idea  was  to  extend 
the  threshold  in  FM  by  demodulating  with  delay,  using 
an  adaptation  of  dynamic  programming.  Slowly  but 
surely  I  began  to  realize  that  traveling  salesmen  prob¬ 
lems  (and  traveling  salesmen,  too)  come  in  many  guises. 
I  now  believe  dynamic  programming  has  a  rdle  to  play 
in  a  variety  of  classical  nonlinear  filtering  problems 
Involving  the  demodulation  of  phase  and  frequency 
modulated  data.  This  is  one  of  the  points  I  hope  to 
make. 

If  you  are  a  control  theorist  who  has  grown  up 
with  dynamic  programming  you  may  be  thinking  my  experi¬ 
ences  with  dynamic  programming  are  rather  too  provin¬ 
cial  to  be  at  all  typical.  Without  presuming  to  speak 
for  my  colleagues,  let  me  at  least  offer  the  following. 
In  1967  Andrew  Vlterbi  published  what  was  to  become  a 
prize-winning,  and  very  Influential,  paper  in  the  IT 
Transactions.  The  paper  was  titled  "Error  Bounds  for 
Convolutional  Codes  and  an  Asymptotically  Optimum  De¬ 
coding  Algorithm  (2]".  In  this  paper  Vlterbi  derived 
an  algorithm  (since  dubbed  the  Vlterbi  algorithm)  for 
finding  the  most  likely  finite-state  convolutional  code 
sequence,  based  on  noisy  data.  As  far  as  I  know,  the 
Vlterbi  algorithm  was  not  widely  recognized  as  a  for¬ 
ward  dynamic  programming  algorithm  until  Forney  pub¬ 
lished  his  account  of  it  in  1973  [31 . 

^This  work  supported  in  pert  by  the  Army  Research 
Office,  Research  Triangle  Park,  NC,  and  the  Office  of 
Naval  Research,  Washington,  DC. 

2 In  this  section  LLS  is  speaking. 


II .  Dynamic  Programming,  the  DFT,  and  the  FFT 

The  DFT  certainly  constitutes  one  of  the  corner¬ 
stones  of  modem  Fourier  analysis.  Its  uses  range  over 
the  entire  spectrum  (so  to  speak)  of  signal  processing 
applications.  American  Microsystems  now  markets  a  pro¬ 
grammable  signal  processor  chip  with  256  16-bit  words 
of  RAM  and  256  17-bit  words  of  RDM  that  performs  3 
million  12  bit  x  12  bit  multiplies  each  second.  The 
chip  can  be  programmed  to  perform  600  32-point  complex 
FFTs  each  second.  With  bit-slice  -^computer  architec¬ 
tures  or  special  purpose  random  logic,  one  can  probably 
realize  something  like  25,000  256-point  complex  FFTs 
each  second.  Special  purpose  FFT  butterfly  chips  no 
doubt  exist.  What  this  means  is  that  DFT  analysis  in 
control  and  signal  processing  problems  can  be  carried 
out  in  real-time. 

The  DFT  is  a  mapping,  DFT:{x  -j"1,  that 


takes  the  sequence  {x 

n  'J 

according  to  the  rule 
N-l 

X  -  l  x  W™1  ,  n 

m  .  »  n  N 
k-0 


into  the  sequence  !X 


m-0,1 . N-l 


Noting  that  W 


1  Vm,  we  may  write  X  3s  follows: 


X  -  Y  x  W-m(N-"' 

m  n  n  N 
n-0 

This  calculation  mav  be  viewed  as  the  limit  of  the 
following  sequence  of  imbedded  approximations  (a  common 
dynamic  programming  trick): 

X(k>  -  l  x  w:ra(k'n)  ,  k=l,2 . N 

ra  .  n  w 

n-0 

(k) 

Note  X  obeys  the  following  recursion: 


x(k+l)  ,  H-»  <k)  +  w-m 
m  N  m  N  x 


X(N)-  X  ;  X(1)  -  x  W~m 

mm  m  ON 

This  is  the  so-called  Goertzel  algorithm  for  obtaining 
the  mth  DFT  variable,  X  ,  as  the  output  of  a  digital 
®  N-l 

filter  excited  by  the  sequence  {x^)^  •  The  output  of 

the  filter  is  read  at  time  k*N.  See  Figure  1. 

Dynamic.  Programming  and  the  Declmat  ion-ln-f  requency  FFT 

The  Goertzel  algorithm  is  a  nice  dynamic  program¬ 
ming-like  solution  for  the  DFT.  However  it  is  not 
efficient.  Let's  see  If  we  can  improve  upon  It.  Con- 
(k) 

sider  X  for  even  frequency  indices  m-2r: 


u-2r(k-n) 

N 


,,-r  (k-n) 


W,2,...,N 


k*l,2 , . . .  ,N 


i 


For  k  even  (eay  k-2s) , 


y  (2s) 

2r 


u-r(2s-n) 

"M/2 


2s-l 

l 

n-0 


V  .  u-2<2s-n)  +  2*r1  x  u'r(2s-n) 
1  xn  WN/2  n.a  xn  N/2 


n-0 


s-1 


u-r(s-n) 


"N/2  n.Q  xn  N/2 


t-0 


ll+s  "N/2 


u-r*  (s)  ,  v(s) 
N/2  *2r  +  T2r 


This  shows  that  the  2s-polnt  DFT  approxlnsnt  X^S'  nay 

be  obtained  from  two  s-polnt  approxlmants.  By  choosing 
s-N/2  and  continuing  backwards  In  this  way  (for  odd 
sub-indices,  as  well)  one  arrives  at  a  backward  dynamic 
programming  derivation  of  the  decimation-ln-frequency 
FTT.  See  Figure  2  for  an  elementary  representation  of 
a  4-point  decimation  In  frequency  FFT. 


Figure  1.  Goertzel  Filter  for 
OFT  Component  X 
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Figure  2.  Four  Eolnt  Decimation 
in  Frequency  FFT 


Figure  3.  Prediction,  Detection,  and  Control  of  a 
Noisy  AR(N)  Sequence 
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III.  Detection,  Estimation,  and  Control 

Structures  in  the  AR(N)  Case:  Kalman 
Filters,  Levinson  Recursions,  and 
Dynamic  Programming 

Autoregressive  (AR)  models  for  signals,  states, 
and  data  play  a  starring  rdle  in  many  areas  of  signal 
processing  and  control.  By  appropriately  selecting 
model  parameters  (and  order)  one  can  model  the  covari¬ 
ance  structure  and  spectral  characteristics  of  more 
general  models.  The  so-called  normal  equations  for 
identifying  the  parameters  are  elegant  and  easily 
solved  with  recursions  of  the  Levinson-type. 

In  this  section  ve  tie  up  control,  prediction, 
detection,  and  estimation  In  the  special  case  where  we 
are  dealing  with  a  zero-mean,  wide-sense  atatlonary, 
scalar  autoregressive  time  series.  The  usual  state- 
variable  and  matrix  block  diagrams  give  way  to  scalar 
variables  and  digital  filter  blocks  of  moving  average 
filters.  The  normal  equations  are  high-lighted  and 
dynamic  programming  is  used  to  derive  the  famous  Levin¬ 
son  recursions. 

Models 


Let  {x^}  denote  a  scalar  zero-mean,  wide-sense 

stationary  autoregressive  sequence  that  obeys  the  re¬ 
cursion 


N 

x.  •lax,  +  w.  V  k 
k  ‘  n  x-n  k 
n-i 

2 

w>n  :  sequence  of  i.i.d.  N(0,aw)  r.v.s. 

It  is  easy  to  see  that  the  covariance  sequence  {r  }-(B, 
rm  “  r-m’  asaociate<1  wlth  th€  sequence  {x^}  obeys  the 
recursion 


r 

m 


N 

r 

n-1 


a 

n 


r  +o 
m-n  w 
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m 


m-0,1,  a  a  .  , 


Prom  here  one  may  write  out  the  so-called  normal  equa¬ 
tions: 


V0  rl  ••• 

rN-l 

*l" 

V 

ri  ro  ri  ••• 

rN-2 

“2 

r2 

• 

rl 

; 

. 

rN-l  rl 

r0 

aN 

rN 

- 

- 

- 

—  - 

If  the  (a  )*  are  known  these  equations  are  used  to 
n  a 

solve  for  the  {r  ).  Conversely,  If  the  (r  )n  are 

n  n  w  N 

known,  these  equations  are  used  to  solve  for  the  { an ) ^ . 

In  much  of  what  follows  we  will  assume  the  sequence 
(x^)  is  observed  in  zero-mean  additive  WCN: 

*k  *  %  +  "k  V  k 

2 

n^  :  sequence  of  i.i.d.  N(0,o^)  r.v.s. 

The  companion  form  state  model  for  all  of  this 
follows: 

Vfi  * A  *k  +  buk 

zk  *  C'S 


*k  ’ 

Xk-N+1 

A  * 

Vl 

*k  . 

0  I 


■  I 


0  I 

’a“  ‘ 


I.  b-C- 


Vvi 


N-l"’aoj 

Noisy  Prediction  and  the  Kalman  Predictor 


The  stationary  Kalman  one-step  predictor  for 
the  noisily  observed  AR(N)  sequence  is 


%+l 


A  Xk  +  K(V^> 


where 


K  -  APC(C'PC  +  a2)'1 
n 

*  fk1(k2 . kj,)' 

P  •  (A-KC')P(A-KC')  +  o2  KK'  +  3  2  bb ' 

n 

The  Kalman  prediction  sequence  (x^^!  for  (z 


k+1 


(1) 

(2) 

} 


can  be  interpreted  as  the  output  of  an  ARMA(N.N-l) 
filter,  driven  by  the  prediction  error  sequence 
(v^-z^-x^J  or  an  ARMA(N,N-1)  filter  driven  by  the  obser¬ 
vation  sequence  {z  ).  The  resulting  filter  equations 

aro  K 


N  .  N 

*k+l  "  E  ai  *k+l-l  +  1  Vk+l-t 

i-1  i-1 


N  N 

Vi  *  iz1  (ai-gi>Vi-i  +  Wi-i 


(3) 


where  the  coefficients,  g^,  can  be  defined  by  the  char¬ 
acteristic  polynomial  A(\)  of  (A-KC'): 


A(X) 


,N  .  ,  ..N-i 

A  +  I  (gi-aJl)X 


i-1 


See  Figure  3  for  a  block  diagram  of  this  predictor. 

Note  that  the  noise-free  MA  predictor  filter  vnext  sec- 
N 

tlon),  I  a  z  ,  Is  preserved  in  the  feedback  loop, 
n-1  n 

but  that  the  residual  sequence  *a  now  weighted 

N 

with  a  feedforward  MA  filter,  l  g  z~n. 

%  n 
n-1 

Why  is  the  noisy  Kalman  predictor  ARMA  and  not  MA? 
The  answer  is  that  a  noisy  version  of  an  AR  signal 

process,  obeys  an  ARMA(N,N)  difference  equation.  As  an 
AR(N)  model  has  an  MA(N-l)  predictor.  It  is  at  least 
logical  (if  not  intuitive)  that  an  ARMA(N,N)  process  has 
an  ARMA(N,N-1)  predictor. 

The  Noise  Free  Predictor 

The  prediction  vector  consists  of  the 

fZ[xk-N+l/zk-l’‘" 


E^xk-l^*k-l ,lk-2’ "  '  ^ 


E!xk/Vl,zk-2*"-  1 


3 


n-1,2,. . . 


E|Vn/lk-n'I,-n.V'' 

'  E|V,/Vn-"1  *  Vn 


So  in  this  case 


*k/k-l 


k-N+1 

Vn+2 


Is 


0  ..  0 


Calculating  K  by  substituting  (4)  into  (1)  one 
finds  that  A(X)  -  XN  and  hence  g^-a^.  This  implies, 

one  would  expect,  that  the  prediction  filter  (3)  re¬ 
duces  to  the  purely  moving  average  relation 

N 

*k+l  " 


l  a.  z..,  , 

i-1  1  k+1‘1 


Minimum  Variance  Control 

One  of  the  simplest  control  strategies  is  minimum 
variance  regulation  where  one  desires  to  minimize  the 
variance  of  the  AR(N)  output  sequence  (x^},  and  force 

Efx^l-O.  The  well  known  separation  principle  allows 

one  to  generate  a  feedback  control  strategy  assuming 
nolsefree  measurements,  i.e.  ty-0,  and  then  use  the 
same  strategy  in  the  noisy  case  but  with  the  Kalman 
filter  estimates  {x^l  replacing  the  actual  filter  out¬ 
puts 

Assume  then  we  have  the  system 
N 

*k  -  ^  *iVi  +  wk  +  vk 

where  {v^}  is  our  feedback  control  sequence.  We  would 
like  to  minimize 

N 

E  (  E  at  Vi 


E<x^). 


i-1 


+  w 


This  control  is  Illustrated  in  Figures  3  as  a  feedback 
loop  running  up  the  left  side  of  the  figure.  The  feed¬ 
back  loop  to  the  top  compute  boa  shows  how  would  be 

used  for  minimum  variance  control  In  the  noisy  case. 
Detection  and  the  Likelihood  Ratic 

Consider  the  hypothesis  test  HQ  vs.  with 


Vi 

_*k/k-l_ 

It  follows  that  P.  the  covariance  EliC^-X^] 

To  ...  o] 

(4) 


k-0,1 . K 


H. 


"I  •  *k  ‘  *k  +  "k 
This  test  is  equivalent  to  the  test  fig  vs.  where 

u  .  .,(0)  _  .  ,,/rt  „2^ 


k-0,1 . K 


and  v, 


1  ' 
(1) 


:  N(0,o‘> 

2, 


k  ‘k 

:  N(0,p0+o^)  ;  P0  :  variance  of  ^ 
x,  is  the  innovations  sequence  in  the 


Kalman  filter.  The  log-likelihood  ratio  for  this 
problem  Is 


LR 


K  - 


K 

I 

k-0 


21  ; 

vk  +  “2  E 
a  k-0 
n 


2  2 

Thun  the  statistics  Ev*  and  are  sufficient  and  the 
log-likelihood  ratio  may  be  computed  as  in  Figure  3. 

The  Normal  Equations  are  Fundamental 

It  should  be  clear  from  Figure  3  that  the  AR  coef- 

u 

flclants  (»n)1  characterizing  the  sequence  (x^)  are 

fundamental  to  the  implementation  of  control,  predic¬ 
tion,  and  detection  algorithms  on  noisily  observed  AR 
sequences.  Unfortunately,  sequences  rarely  come  tagged 
with  their  corresponding  AR  parameters.  More  typically 
finite  records  of  them  come  to  us  and  we  estimate  a 
covariance  function  (or  power  spectrum),  often  by  FFT- 
lng,  squaring  and  windowing,  and  inverse  FFT-lng. 

These  estimates  may  then  be  used  to  solve  for  the  coef- 

flclents  (nn)j  from  the  normal  equations 


(4) 


This  makes  the  normal  equation:  fundamental  and  arouses 
our  Interest  in  efficient  ways  of  solving  them- 


ro  '  '  ' 

rN-l 

al" 

V 

ri  ro 

* 

a2 

■ 

*2 

rN-l  -  • 

• 

o 

1 

aN 

rN 

E  (wk +  2Vk +  aiVi)  + 


(wk  +  1E1  aiVi>  ) 

E(v2)  +  2E(wkvk|vlt)E(vk) 


)2). 


+  2E<“k(1E1  *iVi»  +  E((vk  +  tlt  Vk-i 

Since  {«k)  is  uncorrelated  with  j ) .  W,  and  since 
E(wkvklvk)  •  0,  it  is  clear  that  minimized  by 
choosing 


Dynamic  Programming  and  Levinson's  Algorithm 
Rewtlte  the  normal  equations  as 


N  M 

Jl  ““  r'"-l 


n-1,2, . . .  ,N 


(4a) 


These  equations  characterize  the  liOj  that  minimize 
the  quadratic  form 

QN  •  r0  •  2jj  V.  +  Vn  f  I  n-m  | 

The  minimum  la 


^ . V  •  ^  -  .1,  < 


(*b) 


Assuming  the  normal  equations  to  be  non-singular,  we 
■ay  write 

N  ^  u 

a,  •  *  S"  r  ,  ■'■1,2 . N  (5 


V'l . V  “  r0  '  2  *  r«  Sli  rB 

••1  n-l 

Write  out  Q||(‘)  aa  follows: 

0-1  N-l  N-l 

<4j(r,  •  • • * »r„)-rn-2  Z  o  r  -2a  r  +  I  I  n  o.  r,  , 

1  »  0  m  ■  N  N  ,-1  n.x  ■  "  l■'»l 


**iW|h|  +Vo 

“  °Nr0~2oNrN+^N-l (  V°NrN-l . rM-l_aHrl> 

So  the  minimization  of  QN(rlt .. . ,rN>  with  respect  to 

(a  }®  leads  to 
■  X 

Vri . V  ’  mln  Qij<ri . V 

'•A 

“  “1“IoHr0"2VH+  Bl"  1Wrl-VB-i'*“)* 

«N 

"  *1,l^aKru'2aHrN+<JH-l(ri*<,MrH-r  ‘  ‘ *  (7) 


Thlt  equation  coot* ins  thm  essence  of  dim— ic  program- 


■inn  and. the  principle  of  optimality: Oncethe 

y,i 

(a^, .  •  •  ,a||_^)  are  found,  aay  be  constructed  and 

found  as  a  function  of  r0>rN  and  (s^ . ^1. 

One  continues  In  this  way.  At  each  atep  of  the  way 
the  minimization  problem  on  <),,.(■)  Is  quadratic. 


M-1  N-l 
rH  -  t  a"  1  r 

N  n-l  0  H-n 

iTT¥a  ~ 

rft  -  l  l  r  a*  V  „ 
0  m-1  n-l  "  N‘n 


Lat's  call 


K-a  an 


,  n-1,2 . N-l 


and  see  If  we  can  find  a  recursion  for  It.  In  the 

■centime 

“I1  H-l 

N  Vn 

N.j. 

ro  -  1  C„  Vn 

n-l 


N2  M_1  N-l  N  N'1  N-l 

“n  (r0  *  2  Cn  rN-n)~2aN(rN  *  2  “n  rN-n) 

n-l  n-l 

-  “S(rH-nfl“n  Vn’^Vj^  lrN-n) 

N1  "_J  N-l 

‘  (rN  -  *  “n  rN-n) 

n-l 

So  wa  have  thla  recursion  for  the  mini BUD  prediction 
error: 

QII(r1,...,rH)-Qfj  l(r1 . rN-l)_%(rH'nf1an  ^N-n* 

Now  use  (4b)  to  get 

»  W  "-1  N-l  N  N*1  N  N-l 

r0-  I  ar-r-  Z  a  r-ar„+  Z  a-a  r 
0  «-l  n  "  0  m-1  “  "  N  N  n-l  "  N  N'n 


Let's  use  (6)  In  the  RHS  of  (7): 

QS(ri . V  “  “lnIaSro  -  2Vn  +  ro 


"  m-1  n!1<r"’aNrN-m)  Smn  <Wm-i«)1 
.  N-l  N-l 

-  -in[a2(r0-  I  I  W^n> 

n-l  n-l 

N-l  N-l  , 

-2o  (r  -  l  r  I  s""A  »  ) 

N  N  «-l  "n-l  *m  "  " 

*  ^N-t^rl' ' ' ' ,rN-l^  ^ 

It  follows  easily  that  the  alnlaltlng  value  of  is 


»N  '  1  1  r  S_  r 

N  W  ■-!  n-l  *  *"  W  " 
aN  N-l  N-l  „  , 

tn  -  l  l  r  S"-1  r 

0  n-l  n-l  N"*  *"  N'n 

Use  (S)  In  the  niasrator  to  get 


M  u.i  «j 

1  a«  rm  ■  1  (am  ~a  N 

^■1  ®  ra  n— 1  10  **  “~m  * 

II 

Thu*  from  the  recursion  on  QM  we  get  this  recursion  for 
N  " 

the  a  : 


N  H-l  N  N-l 

a  -  a  -  a„  au 
a  m  N  N-n 


,  m-1, 2 , . . . ,M-1 


Our  one  remaining  problem  Is  C  .  Write  It  aa 

n 

N  N  N 

<£  -  *  V  Vl-n 

n-i 

u 

Thus  Bust  be  the  solution  of 

CB  r | n— <■  |  ‘  rN*l-n  *  n_1*2 . "_1  (,) 

It  therefore  sstlsflet  a  recursion  just  like  a*.  In 

fact  (9)  la  just  (4s)  with  ths  RHS  vector  turned  upside 
down,  iy  the  synsetry  of  R  •  { r |— _n | ) •  this  slaply 

turns  the  solution  vsetor  la|j)  upside  down.  Thus 

r!*«vi-  •  -1’2 . " 

and  wa  era  dons. 


Swssry:  Ths  Levinson  r  scuts  Ions  aay  now  ba  written 


aN  - 

rN  ' 

N-1  N-l 

1  “n  rK  „ 

n-l  N_n 

°N 

n 

O  | 

*  1 

"i1  N-i 

to  r 

n-l  N'"  N-n 

N 

N-l 

N  N-l 

a  » 

m 

a 

m 

'  °N  °N-m  • 

-N-l 

N  ,  "-1 

qn  - 

Vl 

"  aN  <V  * 

ra-1 

N-l 


rN-m* 


To  get  these  equations  into  their  fully  modern  form, 
one  must  look  at  a  backwards  prediction. 

IV.  Frequency  Tracking  and  Dynamic  Programming 

Phase  and  frequency  tracking  problems  comprise 
some  of  the  most  nettlesorae  nonlinear  filtering  prob¬ 
lems  in  the  entire  re*lm  of  signal  processing  and  com¬ 
munication.  A  typical  problem  is  the  following: 
observe  the  sequence  {2^}  with 


iukk 


2i (Q-l) /q) ,  evolving  according  to 
+  vk 

wkN+4  *  “kN  •  ‘'O'1 . “-1  V  k 

A  typical  sequence  {w^}  is  illustrated  in  Figure  4.  The 

independent  increments  sequence  is  a  sequence  of 

i.i.d.  r.v.s.  selected  in  such  a  way  that  the  transition 
probabilities 

£  <u‘kN/u>(k-l)N) 

correspond  to  our  notion  of  physical  reality.  Physi¬ 
cally  ve  may  think  of  the  sequence  as  a  finite- 

state  random  walk  on  the  circle  with  an  unusual  transi¬ 
tion  probability  structure.  Typical  trajectories  for 

J“kk 

and  (s^-e  }  are  Illustrated  In  Figure  4 . 

Let's  organize  the  sequence  {z^}^  into  contiguous 

blocks  of  length  N,  of  the  form  <*kN+!  J^Q.  See  Figure 
5.  Recall 


Km(kN+l> 


+  "k.N+1 


-  ♦  n 

K-l 


kS+l 


KN  u_  i 

Write  [z  }  -  U  { a  > .  rt.  Consider  the  Joint  den- 

k  0  kN+£  £-0 

slty  of  (.„}«  and  (^l^s 


K-l 
f<  U  { z 
k-0 


N_1  K-l 
kN+t^O  * (“kN*0  * 


and  estimate  the  FM  sequence  ti^l.  Here  s^  «  e  *  la 

a  randomly  frequency  modulated  signal.  The  sequence 
f°k^  I®  additive  noise  and  {w^}  Is  a  sequence  of  angular 

frequencies.  Assume  n.:N(0,o^)  (complex  normal) . 

KN 

We  wish  to  observe  a  record  of  data  U^Iq  and 


Exploit  the  structure  of  (z^)  and  to  write  this 


K-l  N-l  Jo,  (kW-t)  -  K-l 

f(-,0  -  *  «  N  (e  k*  ,o‘)  »  fUjAu 

k-0  4-0  *kim  k-0  k*1  **  1)N 

The  natural  logarithm  of  f(-,-)  is  proportional  to 

,  K-l  N-l  -J«kN(kN+i) 

inf  (• ,  •)  -2Re  -~j  £  £  t  ‘ 

2o  k-0  1-0 

n 

K-l 

+  ,£  f<“kN/“(k-l)N) 

k-0 


/*  \KN 
"k  0  • 

K 

u. 

ku 

V- 

u. 

u. 

£ 

t 

Ue 

-  t 

u. 

*  1 

•  ' 

1 

►  1 

O 

o'¬ 


er 

o' 


o 

cT 


3 

X 


1 

t 

S 

0-1 


Figure  5.  Data  Procasslng  and  Frequency  Trellla 
Illustrating  Evolution  of  Surviving 
Frequency  Tracks 
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mum  i  - 


-i 


.  K-l  -ju  itN  N-l  -ju.  Ni 

tnf(-,0  2Re - =r  Z  e  Z  z-M,,e  + 

2oZ  k-0  ,1-0  *tN 

n 

N-l 

+  k-0  lnf<UkN/“(k-l)N) 

Let  *1^00  denote  the  finite  Fourier  transform 


N-l 

W95  '  **  xkN+l 


J8i 


Then  the  log-llkellhood  function  may  be  written 


K-l  -Ju  kN 

Inf  (•,•)'  2Re - r  Z  e  X^O-w.-J 

2o2  k-0  ™  “ 

n 

N-l 

+  k-0  inf(lJkN/,“(k-l)N) 

KN 

Our  notion  of  the  most  likely  sequence  (u^q  Is 
the  sequence 

“kN+t  “  "kN  *  . N_1  ■  k-0, 1,..., K-l 

*  K-l 

where  la  the  sequence  that  maximizes  ((•>•). 

Thus  we  consider  the  maximization  problem 

1  K_1  -•)“kNkN 

“Xkl"?ReAe  XkN(0*"kN) 

*K-1  o_  k»0 

K-l 

+  k-0  tnf<“kN/“(k-l)N) 


kN'O 

with  r  satisfying  the  following  recursion: 

rt  -  rt.1+lnf(wt(|/U(t.1)N)+  ±  Re  e  J“tNtNxtN<8-"kN> 

n 

So  our  maximization  problem  becomes 


Write  this  as 

max  T, 

.if. 


K-l 


I  iK-1 

“kN}K-2 


[  max 

,  ,K-3 

"kN  0 


rK-2  ^n^w(K-l)N^u(K-2)N^  + 


Re  e 


-jw 


(K-l)N 


(k-l)N 


(K-l)N  1  ' 


This  form  leads  to  the  following  observation:  the 
maximizing  frequency  trajectory,  call  It  (u^),  passing 
through  “(g_2)N on  w*7  to  “(k-I)N’  ™u®t  *r rlve  *t 
"(K-2)N  alon*  *  rout*  (“  ,K'3 


1 

kN  0 


that  maximizes!-, 


K-2' 


If  It  did  not  we  could  retain  ,nd  u(k-1)N  and 

with  a  different  sequence  to  get  a  larger  t-^.  It  Is 

this  observation  that  forms  the  basis  of  forward 
dyanmlc  programming. 


Recall  the  Wyj  t(2*r/<))^.  This  means  the 
finite  Fourier  trensform  XU((8)  must  only  be  evaluated 
on  9-2»r/Q,  r-0,1, . . . ,Q-1.  The  best  way  to  do  this  Is 


N  X 

to  zero-pad  to  obtain  a  Q-polnt  sequence 

that  can  be  FFT’d  to  get  X^O-lsr/Q) .  See  Figure  S. 
Then  for  each  node  on  Figure  5  we  evaluate  X^O-lerA)), 

and  find  the  best  route  through  the  trellis  with  a 
dynamic  programming  algorithm.  This  completes  our 
algorithm  for  moderating  the  usual  peak-picking  rule  on 
the  FFT  with  prior  information  f (u  /u  ). 
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